THREE-DIMENSIONAL MEASUREMENT DEVICE 
AND THREE-DIMENSIONAL MEASUREMENT METHOD 

RELATED APPLICATION 
[0001] This application is based on Patent Application 
No. 2000-155768 filed in Japan, the entire content of 
which is hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 
[0002] The present invention relates to a three- 
dimensional measurement method and device for obtaining 
position information of an object by projecting light and 
receiving the light reflected from the object. 

DESCRIPTION OF THE RELATED ART 
[0003] Three-dimensional measurement can be 
accomplished using the time of flight (TOF) from the 
moment of light pulse transmission to the reception of 
the returning light pulse reflected by an object since 
this TOF is dependent on distance. 

[0004] Japanese Laid-Open Patent Application No. Hll- 
508371 discloses a device using a solid state area sensor 
as a photoreceptor device for modulating light entering 
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the solid state area sensor by a photoelectric modulator. 
The distance is reflected in the amount of exposure light 
of the solid state area sensor by photoreception 
modulation synchronized with the projection light- The 
distance information to the object can be obtained 
regardless of the reflectivity of the object by 
determining the ratio of the amount of exposure light 
with modulation and the amount of exposure light without 
modulation. A measurement of distance to multiple points 
(so-called three-dimensional measurement or three- 
dimensional input) can be accomplished at higher speed 
using a solid state area sensor than which deflects the 
optical path by a scanning mechanism. 

[0005] Japanese Laid-Open Patent Application NO. HIO- 
332827 discloses a device for repeatedly projecting pulse 
light at uniform intervals, standardizing the amount of 
light of the reflected and returning pulse light which 
enters a solid state area sensor, and measuring the 
amount of light exposure in a specific period. The 
amount of exposure light is proportional to the frequency 
(number of pulses) of the reflected pulse light, such 
that the exposure light is slight when time-of -flight is 
long and the distance far. Three-dimensional input 
independent of the reflectivity of the object is possible 
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by standardizing the amount of light of the reflected 
pulse light. 

[0006] It is difficult to make a device compact since 
a light modulation device must be included in a 
construction for controlling the exposure timing of the 
solid state area sensor by light modulation as described 
above. In a construction for standardizing the amount of 
light of the reflected pulse light, disadvantages arise 
inasmuch as the allowed range of reflectivity of the 
object and the measurable distance range are limited by 
the performance of the optical system used for such 
standardization, such that resolution is determined by 
the period of the projection. 

[0007] In the aforesaid conventional constructions, 
high-speed measurement at short distances is difficult 
because each uses a method of detection of the length of 
the time-of -flight based on the amount of exposure light. 

SUMMARY OF THE INVENTION 
[0008] An object of the present invention is to 
eliminate the previously described disadvantages. 
Another object of the present invention is to realize 
high-resolution three-dimensional measurement in a 
compact form factor. Another object of the present 
invention is to realize three-dimensional measurement 
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capable of input of a desired precision in the three- 
dimensional measurement. Still another object of the 
present invention is to increase the distance range in 
three-dimensional measurement . 

[0009] These and other objects are attained by a 
three-dimensional measurement method for measuring a 
distance to a plurality of positions on an object by 
projecting light and receiving light reflected from the 
object/ said three-dimensional measurement method 
comprising the steps of: projecting a pulse light on an 
object; receiving light reflected from the object by an 
area sensor comprising a plurality of photoelectric 
conversion elements; controlling the active/inactive 
timing of the area sensor such that the photoelectric 
conversion elements are exposed to light with a timing 
synchronously with the pulse light projection; and 
measuring the distance to each photoelectric conversion 
element based on the output of the area sensor. 
[0010] These objects of the present invention are 
further attained by a three-dimensional measurement 
device for measuring the distance to a plurality of 
positions on an object by projecting light and receiving 
the light reflected from the object, said three- 
dimensional measurement device comprising: a projector 
for projecting pulse light on an object; an area sensor 



4 



comprising a plurality of photoelectric conversion 
elements for receiving light reflected from the object; a 
controller for controlling the ON/OFF states of the 
photoelectric elements with a timing synchronized with 
the pulse light projection; and a processor for 
eliminating the fluctuating component of the received 
light intensity due to distance or reflectivity of the 
object from the amount of exposure obtained based on the 
ON/OFF control. 

[0011] These and other objects are attained by a 
three-dimensional measurement method for measuring a 
distance to a plurality of positions on an object by 
projecting light and receiving light reflected from the 
object, said three-dimensional measurement method 
comprising the steps of: sequentially projecting light of 
a first luminance distribution and light of a second 
luminance distribution on an object; receiving light 
reflected by the object in each projection cycle by a 
solid state area sensor comprising a plurality of 
photoelectric elements; and measuring the distance to 
each photoelectric element based on the output of the 
solid state area sensor in a first projection and the 
output of the solid state area sensor in a second 
projection . 
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[0012] The invention itself, together with further 
objects and attendant advantages, will be best understood 
by reference to the following detailed description taken 
in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] FIG. 1 shows the structure of a three- 
dimensional measurement device of a first embodiment; 
[0014] FIG. 2 illustrates the measurement principle; 
[0015] FIG. 3 shows the basic structure of the image 
^ processing circuit; 

\j\ [0016] FIG. 4 illustrates the operation of the CCD 

Li i 

Lfl sensor; 

m [0017] FIG. 5 is a signal waveform diagram showing the 

D control of the projection and reception light when using 

H a CCD sensor; 

D [0018] FIG. 6 illustrates the operation of a MOS-type 

sensor; 

[0019] FIG. 7 is a signal waveform diagram showing the 
control of the projection and reception light when using 
a MOS-type sensor; 

[0020] FIG. 8 is a signal waveform diagram showing a 
first modification of the control; 

[0021] FIG. 9 is a block diagram showing a first 
modification of the image processing circuit; 
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[0022] FIG, 10 shows a second modification of the 
control ; 

[0023] FIG. 11 a block diagram showing a second 
modification of the image processing circuit; 
[0024] FIG. 12 is a flow chart of the mode 
discrimination related to three-dimensional data 
calculation; 

[0025] FIG. 13 is a waveform diagram showing the 
relationship among the three mode types and light 
receiving time; 

[0026] FIG. 14 shows a third modification of the 
control ; 

[0027] FIG. 15 shows the summary of a fourth 
modification of the control; 

[0028] FIG. 16 is a block diagram showing a third 

modification of the image processing circuit; 

[0029] FIG. 17 shows a modification of the optical 

system; 

[0030] FIG. 18 shows the structure of a three- 
dimensional measurement device of a second embodiment; 
and 

[0031] FIG. 19 illustrates the measurement principle 
of the short distance mode. 
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[0032] In the following description, like parts are 
designated by like reference numbers throughout the 
several drawings. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

First Embodiment 

Device Structure 
[0033] FIG. 1 shows the structure of a three- 
dimensional measurement device of the first embodiment. 
Part (a) shows the entire structure, and part (b) shows 
the structure of the image sensing surface. 
[0034] A three-dimensional measurement device 1 is 
provided with a light source 11, projection lens 12, 
light receiving lens 21, and solid state area sensor 22. 
The light source 11 receives power from a light 
generating circuit 32, and emits laser light. An object Q 
is illuminated by the laser light passing through the 
projection lens 12- The light reflected from the object Q 
passes through the light receiving lens 21, and impinges 
the solid state area sensor 22. The solid state area 
sensor 22 has pixels which block the light from outside 
the device, and part of the laser light from the light 
source 11 passes through an internal optical path 15 
comprised of optical fiber without passing outside and 
directly impinges the pixel as "standard light." 
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Hereinafter, the light passing through the light 
receiving lens 21 and impinging the solid state area 
sensor 22 is referred to as "measurement light," the 
pixel impinged by this measurement light is referred to 
as the "measurement pixel," and the pixel impinged by the 
standard light is referred to as the "standard pixel." 
[0035] The solid state area sensor 22 operates in 
accordance with a clock of the timing controller 33, and 
outputs image signals SG representing the amount of 
exposure on each pixel of the unit photoreception area to 
an image processing circuit 34. The image processing 
circuit 34 performs specific calculations, and distance 
data DL obtained from these calculations are transmitted 
to a storage memory 35 and a display 36 used for a 
monitor display. Controls relating to the light 
projection and reception and signal processing in the 
three-dimensional measurement device 1 are managed by the 
system controller 31. 

Measurement Method 
[0036] FIG. 2 illustrates the measurement principle. 
[0037] The light source intermittently emits light in 
accordance with light-emission control signals which 
repeatedly and alternatingly switch ON/OFF the light 
emission in regular periods. The exposure light of the 
solid state area sensor is an intermittent exposure light 



synchronized with the light emission timing in frame (n). 
Although the light emission timing and the exposure 
timing match completely in the drawing, the timing also 
may be shifted insofar as they are synchronized, and the 
length of the period (pulse width) may be slightly 
different for the emission light and the exposure light, 
[0038] In the present invention, "sensor exposure 
light" refers to the light exposure when the sensor is in 
the active state. "Sensor exposure light" does not 
include light exposure when the sensor is in the inactive 
state. Accordingly, "exposure control" in the present 
invention refers to control of the sensor active/inactive 
timing. 

[0039] At time tl, part of the emitted light (standard 
light) is propagated through the internal optical path 
and impinges the standard pixel. The incidence of the 
standard light starts from time t2 after a time Dref has 
elapsed which matches an emission delay time (offset 
time) from time tl and the time for propagation within 
the internal optical path. The incidence of the 
measurement light from an object starts from time t3 
after a time Dl has elapsed which matches the emission 
delay time from time tl and the time for propagation in 
the external optical path. Since the exposure of the 
solid state area sensor also stops when the emission 
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light stops at time t4 , the amount of exposure of the 
measurement pixel in a single exposure is a value 
corresponding to the reflectivity of the object and the 
distance to the object. The chief cause of fluctuation 
in the amount of exposure dependent on the distance, in 
addition to the difference in exposure time due to the 
incidence delay, is the attenuation of the light 
intensity (i.e., intensity decreases with increasing 
distance). If the reflectivity of the object is known 
beforehand, it is possible to determine the distance 
based on the amount of exposure. The measurable distance 
is determined by the length of a single light emission 
period. Error can be reduced by determining the distance 
based on the total amount of exposure (accumulated 
electric charge) of one frame when light is projected and 
received a plurality of times within one frame period. 
[0040] On the other hand, it is difficult in practice 
to know beforehand the reflectivity of each part of an 
object. In frame (n+1), there is continuous exposure 
light on the solid state area sensor. In this way the 
amount of exposure in frame (n+1) is mainly an amount 
corresponding to the reflectivity of the object 
(reflectivity data). Accordingly, distance data 
excluding the object reflectivity component from the 
distance data can be obtained by performing the following 



calculations for each pixel of the solid state area 
sensor. Distance data= (distance data) reflectivity 
data)= [image data of frame (n)]^[image data of frame 
(n+1)] . 

[0041] This calculation is performed by the image 
processing circuit 34 having the structure shown in FIG. 
3. 

[0042] The image signal SG transmitted from the solid 
state area sensor 22 is quantified by an AD converter 401, 
and output as image data DG. 

[0043] The image data DG (distance data) of frame (n) 
are temporarily stored in a frame memory 410. 
[0044] When the image data DG (reflectivity data) in 
frame (n+1) are output from the AD converter 401, the 
image data DG of frame (n) are simultaneously output from 
the frame memory 410, and a dividing device 42 0 performs 
the aforesaid calculation. 

[0045] The effect of the emission delay time is 
excluded by the following correction calculation based on 
the distance data of the measurement pixel and the 
distance data of the standard pixel, and the distance 
from each measurement pixel to the object can be measured 
with greater accuracy. 

Corrected distance data= ( distance data of the measurement 
pixel) -(distance data of the standard pixel) 
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[0046] An image processing circuit 34 may be provided 
to perform this calculation function, or the calculation 
may be performed by the system controller 31. 

Example of the Solid State Area Sensor 
[0047] Either a CCD sensor, or MOS-type sensor may be 
used as the solid state area sensor 22. 
[0048] FIG. 4 illustrates the operation of a CCD 
sensor. Part (a) schematically shows the structure, and 
part (b) shows the control timing. The state of each 
time to, tl, t2, t3, t4 is described below. 
tO: The electric charge photoelectrically converted by a 
photodiode (PD) starts accumulating. 

tl: Gate SHI switches ON, and the accumulated electric 
charge moves to gate SHI. 

t2: Gate SHI switches OFF, and again the PD converted 
electric charge starts accumulating. 

t3: Gate OD switches ON, and the accumulated electric 
charge is discharged from the PD to the substrate at 
periods t2-t3. 

t4: Gate OD switches OFF, and again the electric charge 
starts accumulating . 

The photoelectrically converted electric charge gradually 
accumulates at gate SHI in period Ton by repeating the 
aforesaid operations. 



13 



[0049] FIG. 5 is a signal waveform diagram showing the 
control of the projection and reception light when using 
a CCD sensor. 

[0050] The operation of FIG. 4 is repeated to perform 
intermittent exposure in frame (n), and continuous 
exposure is performed in frame (n+1). The electric 
charge accumulated at gate SHI in frame (n) is 
transferred to reverse gate (|>T1 when gate SH2 switches ON 
at the end of the frame, and is output to the image 
processing circuit 34 in parallel with the exposure 
operation of frame (n+1). 

[0051] FIG. 6 illustrates the operation of a MOS-type 
sensor. Part (a) summarizes the structure, part (b) 
shows the movement of the electric charge, and part (c) 
shows the control timing. The state at times tO, tl, t2, 
t3, t4 are described below. 

tO: Load starts accumulating at PD incidental capacitor 
CI. 

tl: Gate ST switches ON, and the electric charge is 
transferred from incidental capacitor CI to a 
sufficiently large capacity condenser C2 . 
t2 : Gate ST switches OFF, and again electric charge 
starts accumulating in incidental capacitor CI. 
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t3 : Gate RS switches ON, and the accumulated electric 
charge is discharged from the incidental capacitor CI to 
the power line Vcc at periods t2-t3. 

t4: Gate RS switches OFF, and electric charge again 
starts accumulating- 

[0052] The photoelectrically converted electric charge 
gradually accumulates in period Ton in the condenser C2 
by repeating the aforesaid operation. Since the 
incidental capacitor CI is small compared to the 
condenser C2 , the potential of the incidental capacitor 
CI rises greatly by the electric charge accumulation. In 
this way, when gate ST switches ON, the electric charge 
is transferred from the incidental capacitor CI to the 
condenser C2. 

[0053] FIG, 7 is a signal waveform diagram showing the 
control of the projection and reception light when a MOS- 
type sensor is used. 

[0054] In FIG. 7, frame (n) in PD11-PD14 shown in FIG. 
6(a) corresponds to t0--t6, and frame (n+1) corresponds to 
tS^tlO. Frame (n) in PD21-PD24 corresponds to t5-t7, and 
frame (n+1) corresponds to t9~tll. Frame (n) in 
PD31-PD34 corresponds to t6-t8, and frame (n+1) 
corresponds to tl0-tl2. 

[0055] In frame (n), intermittent exposure is 
performed by repeating the operation of FIG. 6, and in 
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frame (n+1) continuous exposure is performed. In frame 
(n), the electric charge stored in the condenser C2 
switches ON the gates SL11'-SL14 at the end of the frame, 
such that signals corresponding to the electric charges 
of PD11-PD14 are stored in a line memory. The signals of 
the PD11"PD14 stored in the line memory are output to the 
image processing circuit 34 by sequentially switching ON 
the switches SV1-SV3. 

[0056] Next, the signals of PD21-PD24 are similarly 
output, and finally when the signals of PD31-PD34 are 
similarly stored in the line memory. the continuous 
exposure of frame (n+1) starts with PD11-PD14, and the 
signals of PD31-PD34 are output in parallel with the 
continuous exposure • 

Counteracting Environmental Light 
[0057] Since environmental light is not dependent on 
the distance to the object, the impingement of 
environmental light on the solid state area sensor is a 
source of measurement error. As a countermeasure for 
environmental light, an optical filter is used to 
selectively transmit light of the wavelength range 
emitted by the light source. However, environmental 
light cannot be entirely eliminated by the optical filter. 
In the embodiments described below, measurement error due 
to environmental light is prevented. 



[0058] FIG. 8 is a signal waveform diagram showing a 
first modification of the control. 

[0059] In frame (n), intermittent light emission is 

performed, an intermittent exposure is performed with a 

timing identical to the emission timing. 

[0060] The environmental light component in the 

exposure light of frame (n) is detected by intermittent 

exposure without light emission in frame (n+1). 

[0061] Intermittent emission and continuous exposure 

are performed in frame (n+2) to obtain reflectivity data. 

[0062] The environmental light component in the 

exposure light of frame (n) is detected by intermittent 

exposure without light emission in frame (n+1). 

[0063] Then, the environmental light component in the 

exposure light of frame (n+2) is detected by continuous 

exposure without emission in frame (+3). 

[0064] FIG. 9 is a block diagram showing a first 

modification of the image processing circuit . 

[0065] In the image processing circuit 34b, the image 

data SG transferred from the solid state area sensor 22 

are quantified by the AD converter 4 01 and output as 

image data DG similar to the case shown in FIG. 3. 

[0066] The. image data DG (distance data) in frame (n) 

are temporarily stored in line memory 411. 



[0067] When the image data (intermittent exposure and 
environmental light data) of frame (n+1) are output from 
the AD converter 401, the image data DG of frame (n) are 
output simultaneously with the image data DG of frame 
(n+1) from the frame memory 411. Distance data from 
which the environmental light component has been 
eliminated are obtained by calculation by a subtraction 
device 430. The output of the subtraction device 430 is 
temporarily stored in the frame memory 412. Furthermore, 
the image data DG (reflectivity data) of frame (n+2) are 
recorded in the frame memory 411 in parallel with the 
readout . 

[0068] When the image data DG (continuous exposure 
environmental light data) of frame (n+3) are output from 
the AD converter 401, the reflectivity data are read from 
the frame memory 411, and the reflectivity data excluded 
from the environmental light component are output from 
the subtracting device 430. Then, distance data DL from 
which the environmental light component has been excluded 
are obtained by the calculation of the dividing device 
420. 

Enlargement of the Measurable Distance Range 
[0069] In the method of controlling the exposure 
timing and measuring distance using the amount of 
reflected exposure light, basically long distances 
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wherein the time of flight is longer than the emission 
time (emission pulse width) cannot be measured. Long 
distances can be measured in the embodiments described 
below. 

[0070] FIG. 10 shows a second modification of the 
control . 

[0071] In frame (n), intermittent emission is 
performed, and intermittent exposure is performed with 
the same timing as the emission. In frame (n+1), 
intermittent emission is performed and intermittent 
exposure is performed with a timing delayed by the 
exposure time relative to frame (n) . In frame (n+2), 
intermittent emission is performed, an intermittent 
exposure is performed with a timing delayed by the 
exposure time of frame (n+1). Then, in frame (n+3), 
intermittent emission and continuous exposure are 
performed to obtain reflectivity data. 
[0072] For example, when the impingement of the 
measurement light starts from time t3 in the exposure 
period (tl2~tl4) of frame (n+1) shown in the drawing, 
distance data corresponding to the propagation time Dll 
and Dll' representing the distance to the object are 
obtained for both frame (n+1) and frame (n+2). These 
distance data are distance data from which the 
reflectivity component has been excluded by division of 
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the reflectivity data of frame (n+3). The distance data 
obtained in frame (n+1) and the distance data obtained in 
frame (n+2) are averaged to determine the distance data 
of each pixel. 

[0073] Since the light returning from the object 
within the emission period from one emission to the next 
emission is always received by setting the exposure 
timing to be mutually shifted from frame to frame, the 
measurable distance, when viewed from the time of flight, 
is increased from the emission period to the emission OFF 
time of the emission cycle. The time Dll from the 
transmission pulse rise to the reception pulse rise 
(hereinafter referred to as "rise time difference") and 
the time Dll" from the transmission pulse fall to the 
reception pulse fall (hereinafter referred to as "fall 
time difference") are measured, and their average is 
designated the measurement value, so as to produce a 
highly accurate measurement. 

[0074] FIG. 11 is a block diagram showing a second 
modification of the image processing circuit. 
[0075] In the image processing circuit 34c, the image 
signal SG output from the solid state area sensor 22 is 
converted to image data DG by the AD converter 401, and 
sequentially recorded in frame memories 411, 412, 413 for 
each frame. When the image data DG of frame (n+3) are 
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output from the AD converter 401, the image data DG of 
frame (n+2) are output from frame memory 411, and the 
image data DG of frame (n+1) are output from the frame 
memory 412, and the image data DG of frame (n) are output 
from frame memory 413. The pixel unit division of the 
image data DG output from each frame memory 411, 412, 413 
and the image data DG of frame (n+3) output from the AD 
converter 401 is performed by the dividing devices 421, 
422, 423, and the distance data DL are calculated for 
each frame (n)-(n+2). Three-dimensional data are 
calculated based on the distance data DL of these three 
frames. The system controller 31 performs the 
calculations . 

[007 6] When performing the three-dimensional data 
calculations, data of two frames representing the 
propagation times Dll and Dll' are selected from the 
distance data DL of the three frames. A description of 
this portion of the process follows below. 
[0077] FIG. 12 is a flow chart of the mode 

discrimination for calculating three-dimensional data, 
and FIG. 13 is a waveform diagram showing the 
relationship between the three modes and light receiving 
times. In FIG. 12, "frame" is represented by the symbol 
" F . " 
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[007 8] The system controller 31 reads the distance 
data of frames (n)-(n+2) obtained by sensing frames 
(n)-(n+3) from the frame memory 35 (#101). Then, the 
magnitude relationship of the distance data values in 
frames (n)-(n+2) are determined for each pixel, and 
calculations are performed for either mode 1, 2, or 3 in 
accordance with the determined relationship (#102-#112). 
[007 9] As shown in FIG. 13, in the standard pixel, the 
distance data of frame (n) represents the rise time 
difference Dref, and the distance data of frame (n+1) 
represents the fall time difference Dref'. The 
propagation time in the internal optical path is 
sufficiently shorter compared to the emission pulse width. 
Accordingly, the distance data of frame (n) and frame 
(n+1) are normally used in the calculation of the 
standard pixel. The determination of modes 1, 2, and 3 
may be performed for the standard pixel just as for the 
measurement pixel, and the distance data selected based 
on the result. 

[0080] In mode 1, the distance data of frame (n) 
represents the rise time difference DlOl, and the 
distance data of frame (n+1) represents the fall time 
difference DlGl*. Accordingly, the distance data of 
frames (n) and (n+1) are used in this calculation. The 
corrected distance data representing DlOl-Dref and DlOl*- 
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Dref • are obtained by subtracting the standard pixel data 
of the same frame from each frame. The average of the 
corrected distance data is designated the distance data 
of the measurement pixel determined in mode 1. 
[0081] Similarly, in mode 2 the distance data of 
frames (n+1) and (n+2) are used, and calculation of 
corrected distance data representing Dl02-Dref and D102'- 
Dref ' as well as the average value calculation are 
performed • In mode 3 the distance data of frames (n) and 
(n+2) are used, and calculation of corrected distance 
data representing D103-Dref and Dl03'-Dref' as well as 
the average value calculation are performed. 
[0082] When measuring long distance as described above, 

it is possible to increase resolution to achieve high 
accuracy measurement by shifting the exposure timing 
between frames so as to have the exposure period of each 
frame shorter than the emission time as shown in FIG. 14, 
and perform a plurality of exposures in the emission 
period (pulse light projection period) with the assumed 
appearance of simultaneity of a plurality of frames. In 
the example shown in FIG. 14 the distance data of frame 
(n) representing the rise time difference Dll and the 
distance data of frame (n+3) representing the fall time 
difference Dll' are used to determine the distance value. 
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[0083] The influence of environmental light can be 
reduced even when measuring long distances. 
[0084] FIG. 15 shows a summary of a fourth 
modification of the control. 

[0085] Intermittent emission is performed in frames 
(n)-(n+2), and intermittent exposure is performed with 
the same or delayed timing of emission. In frame (n+3) 
the emission is stopped and intermittent exposure is 
performed to obtain environmental light data. In frame 
(n+4) intermittent emission and continuous exposure are 
performed to obtain reflectivity data. In frame (n+5) 
emission is stopped, and continuous exposure is performed. 
[0086] FIG. 16 is a block diagram showing a third 
modification of the image processing circuit. 
[0087] In the image processing circuit 34d, the 
distance data DG of frames (n+2), (n+1), (n) are stored 
in frame memories 411, 412, 413. When the environmental 
light data of frame (n+3) are output from the AD 
converter 401, data are simultaneously read from the 
frame memories 411-413, and the environmental light 
component is eliminated by the subtraction devices 431 
and 432. The distance data of the frames (n+2), (n+1), 
(n) from which the environmental light component has tpeen 
eliminated are recorded in frame memories 414, 415, 416. 
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[0088] Then, the reflectivity data of frame (n+4) are 
stored in frame memory 411, and when the environmental 
light data of frame (n+5) are output from the AD 
converter 401, the environmental light component is 
eliminated from the reflectivity data of frame (n-f4) by 
the subtraction device 431. Data are read from the frame 
memories 414-416 simultaneously with the output of data 
from the subtraction device 431, and the distance data DL 
of frames (n+2), (n+1), (n) from which the environmental 
light component has been eliminated are obtained via 
calculation by the dividing devices 431, 432, 433- 

Other Examples of Optical Systems 
[0089] FIG. 17 shows modifications of the optical 
system. Structural elements of the example in this 
drawing are designated by symbols identical to those of 
FIG. 1. 

[0090] In the structure of part (a), light emitted 
from the light source 11 is condensed to the principal 
point of the receiving lens 21 by the collector lens 13 
and polarization mirror 17, so as to be directed to the 
object Q. The light reflected by the object Qv passes 
through the receiving lens 21, 1/4 wavelength plate 16, 
and polarization mirror 17, and impinges a specific pixel 
on the solid state area sensor 22. The polarization 
mirror 17 reflects the perpendicular polarized light, and 
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transmits the parallel polarized light. The 1/4 
wavelength plate 16 inclines the polarized light 45 
degrees. 

[0091] In the structure of part (b), the light emitted 
from the light source 11 is condensed at the principal 
point of the receiving lens 21 by the collector lens 14 
and semi-transparent mirror 18, and directed to the 
object Q. The light reflected from the object Q passes 
through the receiving lens 21 and semi-transparent mirror 
18, and impinges a specific pixel on the solid state area 
sensor 22. 

Second Embodiment 
[0092] Laser light is most suitable as the signal 
medium in distance measurement using the TOP method. 
However, since measurement of light propagation time is 
an event performed at high speed, it is difficult to 
ensure high accuracy at near-field distances - 
measurement of constant precision can be realized 
regardless of whether the distance is near-field or not 
by using the TOF method and the triangulation method. 

Device Construction 
[0093] FIG. 18 shows the structure of a three- 
dimensional measurement device of the second embodiment. 
[0094] The three-dimensional measurement device 2 has, 
in addition to the structural elements of the three- 



dimensional measurement device 1 shown in FIG. 1, a 
triangulation density gradient filter 19, filter 
controller 38, and mode switch 39. 

[0095] The function of the density gradient filter 19 
is variable, an includes projecting a first light and a 
second light having different luminous intensity 
distributions, and a substantially through-like state 
(uniform luminous intensity distribution) . The mode 
switch 39 is a user interface for specifying the 
selection of the far-field mode and near-field mode by a 
user. The mode is not limited to manual selection and may 
be switched automatically by detecting the distance using 
a simple rangefinding sensor. The system controller 37 
issues specific instructions to the filter controller 38 
in accordance with a mode selection signal Sm output from 
the mode switch 39. 

[0096] When the far-field mode is specified, the 
density gradient filter 19 is controlled so as to 
uniformly illuminate the object Q, and distance 
measurement is performed using the TOF method in the same 
manner as the three-dimensional measurement device 1. 
When the near-field mode is specified, the operation is 
as described below. 

isrear-field Mode Operation 
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[0097] FIG. 19 illustrates the measurement principle 
of the near-field mode 

[0098] As shown in Part (a), the characteristics of 
the density gradient filter 19 change the amount of light 
along one direction (Y direction) in a plane 
perpendicular to the optical axis. 

[0099] In frame (n)^ light is projected using the 
density gradient filter 19, and continuous exposure light 
is sensed. Then, in frame (n+1), the density gradient 
filter 19 is rotated 180° about the optical axis, and the 
exposure light is sensed. In this way, the projection 
light intensity ratio of frame (n) and frame (n+1) 
differs at all angles using the optical axis as standard 
as shown in part (b). 

[0100] The distance H between each pixel of the solid 
state area sensor 2 2 and the light source, and the 
incidence angle a of the light received by each pixel are 
known, and the relationship of correspondence between the 
projection light intensity ratio and the ray angles 9 a, 
eb, 9c... are also known. Accordingly, the angle of the 
ray illuminating point q (angle 0b in the example) on the 
object corresponding to a specific pixel can be 
understood by determining the intensity ratio of the 
incident light in frames (n) and (n+1) of that specific 
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pixel. The distance Lq to the point q can be calculated 
by triangulation. The division calculation for obtaining 
the light intensity ratio is performed by the image 
processing circuit 34, and the distance calculation for 
each pixel is performed by the system controller 37, The 
obtained distance data are recorded and displayed. 
[0101] In the first and second embodiments, a solid 
state area sensor 22 capable of sensing color may be used, 
so as to perform three-dimensional measurement and two- 
dimensional color image input, both of which may be 
recorded and displayed. Although the operation has been 
described in terms of obtaining a single three- 
dimensional image, the measurement may be repeated so as 
to have three-dimensional measurement of a three- 
dimensional object. The solid state area sensor may also 
be used to perform a logarithmic compression function. 
[0102] Although the present invention has been fully 
described by way of examples with reference to the 
accompanying drawings, it is to be noted that various 
changes and modification will be apparent to those 
skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of the 
present invention, they should be construed as being 
included therein. 
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